NPS55-90-001PR 



NAVAL 



POSTGRADUATE SCHOOL 

Monterey, California 




AN EXAMINATION OF SOME B003 DATA 



by 

H. J. Larson 

// 

T. Jayachandran 



March 1990 



Prepared for: 

Kelly Air Force Base 
San Antonio, TX 78241 

f 

FedDocs 
D 208.14/2 
NPS-55-90-001PR 



mo od£ 
, 302. 



.u 



-^0-00l 






NAVAL POSTGRADUATE SCHOOL 
MONTEREY, CALIFORNIA 



Rear Admiral R. W. West, Jr. 
Superintendent 



Harrison Shull 
Provost 



This report was prepared in conjunction with research funded by the 
Directorate of Material Mangement, SA-ALC/MMEI, Kelly Air Force Base. 



This report was prepared by: 



DUDLEY KNOX LIBRARY 
NAVAL POSTGRADUATE SCHOO 
MONTEREY CA 93943-5101 



An Examination of Some B003 Data 



H Larson and T Javachandran 



Nava! Postgraduate School 



Introduction 



The Air Force, Navy and Army have for many years employed spectrometric 
analysis of used lubricating oil a 5 an aid in tracking the servicability of many types 
of equipment. Virtually all types of equipment with oil- wetted surfaces are covered 
by this (tri-service) Joint Oil Analysis Program (JOAP). As an oil-wetted surface 
wears, it is possible that small amounts of the metals contacted will be suspended 
in the oil medium. Thus, if the lubricating oil is periodically submitted to a spec- 
trometric analysis, the resulting traces of metallic contaminants may be expected 
to provide information about the amount of wear suffered. Each type of equipment 
monitored by the program has a specified rate at which sampling is accomplished, 
typically based on the number of hours of use or on the number of miles travelled. 

The spectrometric laboratories which process these used-oil samples are gen- 
erally located at military bases, in proximity to the equipments being monitored, 
although a few civilian laboratories are also employed in the program. Person- 
nel employed in spectrometer operation, and interpretation of the resulting analy- 
ses. are trained in specialized schools dedicated to JOAP applications. The JOAP 
Laboratory Manual [ 1 ] provides detailed instructions for all participating laborato- 
ries. describing sampling methods for obtaining used engine oil. spectrometer setup 
and operation, tables of acceptable levels and changes in levels of monitored con- 
taminants for specific equipment codes (for both atomic emission and absorption 
instruments for Air Force engines), recording of data results, and twice-monthly 
forwarding of all JOAP analyses to the San Antonio Air Logistic Center (SA-ALC). 
Kelly Air Force Base, Texas. Participating laboratories must be certified, and main- 
tain certification, through the monthly JOAP correlation program, also described 
in the JOAP Laboratory Manual. 

The data bank of JOAP analyses at SA-ALC is available foi management 
summary reports, either service- wide or for individual commands, and serves as a 
historical record of previous oil analysis records for the whole program. This report 
describes an investigation of some of the data submitted to this data bank during 
fiscal year 19SS. 

Two inajoi points are addressed in this study; the first of these is concerned 
with the normal, marginal, high and abnormal ranges for the various wear metals, 
published in the JOAP Laboratory Manual, for different type of equipment codes 
(TEC s) (separate sets of ranges for the two different spectrometer types). These 
ranges are used by laboratory personnel to decide whether the results of the spec- 
trometric analysis of the used engine oil indicates the need for some special action, 
such as more frequent sampling (because a problem may be developing) or possibly 
even grounding of the equipment if it appears that some type of failure may be 
imminent. So long as the current reading for a given wear metal remains in the 
normal zone, no special action is called for, based on the oil analysis; if a read- 
ing is found in the other zones (marginal through abnormal, in order of increasing 
concentration) special recommendations are outlined in the manual. The values of 
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these ranges drive the frequency with which special actions may be required, with 
lower ranges necessarily causing increased frequency of recommendations for special 
actions. This study investigates the consistency of these normal, marginal, high and 
abnormal ranges across Air Force engine types, to the extent possible, employing 
historic records made available from the data repository at SA-ALC. 

The second point addressed in this report is the discussion of a unified ap- 
proach to defining these normal, marginal, abnormal and high ranges; these ranges 
are presently set by individual Air Force engine managers who may be employing 
quite different rationales and procedures in determining their values. There does 
not currently appear to be any general set of guidelines or recommendations for set- 
ting these ranges; this report discusses this problem and recommends some specific 
procedures in setting, and reviewing, these ranges. 

Data Available 

The Air Force supplied two magnetic tapes of data for this study, containing 
Air Force Oil Analysis data for the processing months of October. 19S7, through 
September, 1988 (fiscal year 1988). Oil sample data only was supplied, not includ- 
ing feedback records: also excluded were oil sample records with Reason Sample 
Submitted code equal to P (Physical Test data), A (Accident /Incident data) and 
J (Equipment Failure data). These records are routinely excluded from the yearly 
baseline Wearmetal Frequency report issued for program managers. The two data 
tapes contained 956.339 records in total, each 165 bytes long. 

Each 165 byte record describes a single oil analysis for a specific piece of equip- 
ment. The quantities identified in each record include 

1 . The laboratory, including the particular instniment . and the command to which 
it belongs. 

2. The activity, home base code for the equipment sampled. 

3. Type equipment code, identification of the type of equipment sampled. 

4. Equipment serial number, identification of the specific individual sampled. 

5. Date the sample was taken from the equipment. 

6. Sequence number 

7. Identification of whether the record contains oil analysis values or feedback 
information. 

8. Date the sample was analysed. 

9. Total time or miles since the equipment was last through overhaul. 

10. Total time or miles since oil change. 

11. Reason the sample was submitted. 

12. Amount of oil added since the last sample. 

13. Type of oil used in the equipment. 

14. Response time required to analyze the sample. 

15. Laboratory recommendation, based on the spectrometric analysis. 
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1C. Spectromotric analysis readings, in whole parts per million, for up to 20 dif- 
ferent contaminants. The particular contaminants tracked can vary from one 
equipment code to another. 

Although not specified, the ordering of the records on the tape appears to be 
chronological, according to the date the data was received by SA-ALC during the 
period covered. The great majority of the dates listed for sample analyses were 
in fiscal year 1988 although some dates were listed as being several years earlier, 
perhaps through errors in data entry. The four-byte type equipment code (TEC) 
field contained a total of 705 different identifiers, indicating this number of different 
types of equipment being covered for the year. The number of analysis records 
available for these different equipment types varied considerably, as indicated in 
Table 1. 



Table 1. Numbers of sample records for equipment codes (TECs). 



Number of analyses 


< 50 


51-200 


201-800 


801-5,000 


5.001-50.000 


> 50.000 


Number of TECs 


471 


120 


56 


33 


1* 


1 



As can be seen from this table, 471 TEC s (more than 2/3 of the total repre- 
sented) had no more than 50 analyses reported to the data bank for the whole year: 
this count of analyses is over a 11 serial numbers of the given TEC Indeed, of these 
471 with no more than 50 analyses, a full 142 had only one analysis for the year 
and 329 had no more than 10. Man}* of these extremely small yearly counts may be 
due to data-entry errors in entering the TEC codes. As can also be seen from Table 
1. there were 7 TEC s with more than 50.000 analyses recorded, which together 
account for 5G r A of all the records on the tapes: the largest number of analyses was 
reported for TEC DFKA, with 138,571 analyses, while TEC EPJA was identified 
with 97.112 analyses. Both of these are turbofan engines which together account 
for almost 25 ( X of the analyses reported on the data tapes. 
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Consistency of Ranges 



One goal of this study was to compare the consistency of the JOAP Labora- 
tory Manual normal, marginal, high and abnormal ranges in the frequency counts 
actually observed for the different elements for operational engines, across various 
TEC s. To accomplish this, the data tape was first scanned to find the number 
of TECs available, with the results already summarized in Table 1. A count was 
then made of the various engine serial numbers (ESN s) listed for each TEC , as well 
as a record of the number of analyses performed for each such ESN. A count was 
also made of the numbers of analyses reported from both types of spectrometers 
employed by the Air Force; atomic emission spectrometers produced 908,961 of the 
records (about 95% of the total) with atomic absorption spectrometers producing 
the remainder. Since it is well known that these two instruments do not produce 
identical ppm readings on the same sample, the reason that the JOAP Laboratory 
Manual includes separate ranges for the two. it is necessary to separate the records 
according to the instrument-type; thus the consistency of ranges can be (and is) 
examined separately for the two instruments. 

As already mentioned, almost 25% of the records reported on the data tape were 
for the two turbo-fan TEC s DFKA and EPJA; both of these had fairly substantial 
numbers of readings for both instrument types and were included in the study. The 
two TECs BSQA and BSPA identify turbo-jet engines (a total of 103.333 records 
between them, about 11% of all the records on the tapes) and also had large numbers 
of readings from both instrument types, so they were examined as well. The third, 
and final, type of engine available with sufficiently large numbers of records to 
examine (from both types of instrument) was the turbo-prop: TEC s LLDA and 
LLLA provided the largest numbers of records for the year (11.755 records between 
them), with both instrument types again fairly well represented. Thus, this study 
focusses attention on three engine types (turbo-fan. turbo-jet and turbo-prop) and 
employs data from two different TEC s for each of these types. 

A number of tabular and graphical presentations of the data for these six TECs 
have been prepared; for simplicity of exposition, only the tables and graphs for TEC 
DFKA, w'hich has the most records, are presented in the main body of this report. 
Discussion is included for all six, with the supporting tables and graphs for the 
remaining five TEC s presented in the appendix. 

It is desired, for this study, to examine the placement of the normal, marginal, 
high, and abnormal ranges within the distribution of contaminant readings for ac- 
tive, operational aircraft. To aid this goal, records with T (Test Cell), K (Prior to 
Maintenance-Removal), M (Post Maintenance Check), P (Physical Test) or X (Ini- 
tial sample) listed in the Reason Sample Submitted field are excluded. In addition, 
the only ESN s utilized were those which contributed at least 40 analyses to the SA- 
ALC data bank in fiscal year 1988 (for TECs DFKA, EPJA. BSQA, BSPA) and at 
least 20 analyses for the turbo-prop engines LLDA. LLLA. This lower number of 
analyses was used for the turbo-prop engines because there are considerably fewer 
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analyses of this type of engine available; this lower number of analyses available is 
undoubtedly caused by a different sampling schedule and/or mode of use for aircraft 
employing this engine type. 



Table 2. Equipment code DFKA, Atomic Emission 



Element 


Normal 


Marginal 


High 


Abnormal 


Proportion 


range 


range 


range 


range 


not normal 


Fe 


0-10 


11-12 


13-14 


15 and over 


0.0012 


Count 


125,893 


68 


12 


65 


Ag 


0-2 




3 


4 and over 


0.0006 


Count 


125,921 




16 


64 


Al 


0-10 


11-12 


13-14 


15 and over 


0.0001 


Count 


125,997 


1 


o 


4 


Cr 


0-4 


5 


6 


7 and over 


0.0001 


Count 


125,989 


2 


3 


9 


Ni 


0-4 


5 


6 


7 and over 


0.0040 


Count 


125.531 


409 


66 


28 


Ti 


0-10 


11-12 


13 14 


15 and over 


0.0004 


Count 


125,963 


31 


3 


12 



Tables 2 and 3 provide counts of the records for TEC DFKA. which fall into the 
normal, marginal, high and abnormal ranges, for the two different instrument types. 
Note that fewer than four classes are used for some of the elements, indicated by no 
specified range or count (see Ag in Table 2. for example, and Ag. Cr. Ni in Table 3. 
where no marginal range is specified in the laboratory manual ). The total number of 
records summarized may differ slightly from element to element, caused by missing 
data for some elements for some records. Also presented is the proportion of records 
nor in the normal range (that is, those that are marginal, high or abnormal). From 
the counts (and proportions) summarized, it would appear that the placement of 
the normal, marginal, high and abnormal ranges are very conservative, in the sense 
that the great majority of records fall into the normal range: the summaries for the 
other 5 TEC s are given in the appendix and present similar results. While these 
proportions found outside the normal range are quite small (and not particularly 
uniform), there is reason to believe that they may in fact be smaller than indicated 
in these tables, as will be discussed in the section on non-normal record^. 

Frequency histograms have also been prepared, giving the proportions of ppm 
readings observed for these records, for the various elements, for both types of 
spectrometers. Figures 1 and 2 present these histograms for TEC DFKA, for the 
two spectrometer types; any proportion which is smaller than .005 is too small 
to appear in these figures. The number of records used in constructing the his- 
tograms is printed at the top; in each case this number of records describes the last 
(bottom-right) histogram in the figure. Since not every record used had values for 
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Table 3. Equipment code DFKA, Atomic Absorption 



Element 


Normal 


Marginal 


High 


Abnormal 


Proportion 


range 


range 


range 


range 


not normal 


Fe 


0-5 


6 


7 


8 and over 


0.0005 


Count 


2,105 


0 


1 


0 


Ag 


0 




1 


2 and over 


0.0247 


Count 


2,054 




51 


1 


A1 


0-6 


7 


8-9 


10 and over 


0.0019 


Count 


2,102 


1 


3 


0 


Cr 


0-1 




2 


3 and over 


0.0000 


Count 


2,106 




0 


0 


Ni 


0-1 




2 


3 and over 


0.0033 


Count 


2,098 




6 


1 


Ti 


0-6 


7 


8-9 


10 and over 


0.0000 


Count 


2,105 


0 


0 


0 



Proportion of readings versus ppm content 

Based on 126,009 records 




1.0 
0.8 
0.6 H 
0.4 
0.2 
0.0 



Ag 



0.0 



j— 




■ 


A1 


- 


-EL^ 



0 1 



0 1 




all elements, there is a (very) small variation in the numbers of counts represented 
in the histograms for the various elements (for the same TEC. These figures give an 
indication of the numbers of times the different ppm values occur, for the various 
elements, for both types of spectrometers; they also give a graphic indication of the 
fact that the atomic absorption readings are smaller than their emission counter- 
parts. The appendix presents the same plots for the other five TEC s summarized. 

In preparing the frequency histograms just discussed, it was noted that there 
appears to be a strong indication that the contaminant readings shift to higher 
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Proportion of readings versus pprn content 

Based on 2,105 records 



0.6 - 



0.4 - 



0.2 * 



0.0 

1.0 
0.8 
0.6 
0 4 
0.2 
0.0 



a 

o 



Fe 



1 2 3 



Cr 



-O- 

1 



1.0 
0.8 
0.6 - 
0.4 - 
0.2 - 
0.0 



Ag 



0.6 

0.4 

0.2 

0.0 



0 1 
Ni 



0.6 

0.4 -I 

0.2 

0.0 



0.8 - 
0.6 - 
0 4 - 
0.2 
0 0 



Ti 



n 



o 1 



0 1 



A1 



JZI_ 



0 1 



0 

Figure 2. Equipment code DFKA, Atomic Absorption 



values with increasing values for the hours since oil change; that is. as the oil in 
the system ages the contaminant buildups seem to increase. This phenomenon is 
described in figures 3 (for atomic emission) and 4 (for atomic absorption). Each 
of these figures presents two histograms, one for those records reporting no more 
than 200 hours since oil change and the other for more than 200 hours since oil 
change. The number of hours at which this break is made was chosen to give 
roughly equal numbers of readings on either side of the break, for both instrument 
types: this breakpoint differs from one TEC to another, as is evident from the 
figures presented in the appendix. 

The unfilled bars give the proportions of readings for the fresher oil. while the 
filled bars give the proportions for the older oil: for every element (for DFKA ) there 
is a noticeably higher proportion of readings for the higher ppm values. Indeed, 
even for element Ag in Figure 3, where the proportions of 0 and 1 values visually 
appear to be essentially equal, there is an extremely significant shift in a statistical 
sense, because of the very large sample sizes involved. This same general increase in 
ppm content occurs for most elements for the other TEC s examined (see the figures 
in the appendix). Such a shift to higher values, for larger values of hours since 
oil change, would seem to indicate that any ranges employed to delineate normal 
versus marginal, high or abnormal should also shift and not be static. This point 
is discussed further in the section SETTING RANGES. 



Proportion of readings versus ppm content 

TT , < 200 □ Based on 60,034 records 

Hours since oil change - _ m u , __ n _- , 

> 200 ■ Based on 65,9/5 records 








2 3 




Figure 3. Equipment code DFKA, Atomic Emission 



Proportion of readings versus ppm content 

r, • -i l < 200 D Based on 1,063 records 
Hours since oil change — _ n , 

® > 200 i Based on 1,042 records 




0 1 0 12 
Figure 4. Equipment code DFKA, 





Atomic Absorption 



Non-normal Records 

Each oil analysis record on the data tapes includes a field which identifies the 
laboratory's recommendation for action to be taken, based on the results of the cur- 
rent spectrometer readings. Thus, it is possible to identify those records on which 
the laboratory made a recommendation for some special type of action, varying 
from requirements for sampling with greater frequency than usual to grounding of 
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the aircraft for inspection or even requesting removal of an engine. This laboratory 
recommendation is to be derived from use of t lie decision guidance table given in 
the manual; this decision guidance table, in turn, requires use of two pieces of in- 
formation. called the range value and the trend value (for each element monitored). 
The range value refers simply to the range into which the sample reading falls, the 
normal, marginal, high and abnormal ranges mentioned earlier. The trend value is 
to be computed by the operator (for each element); this number is the difference 
between the contaminant level found in this current sample and the level in the 
previous sample (for the same ESN), adjusted to a 10 hour flight period. These 
trend values are not reported to the data base at SA-ALC, and are not provided on 
the data tapes. 

This decision guidance table provides a suggested laboratory recommendation 
based on the current range values, the previous sample’s range values and the trend 
value. It uniformly recommends special action codes for any sample reading in the 
high or abnormal ranges, for any element, and suggests consideration of a special 
action code for any sample reading in the marginal range. The decision guidance 
table suggests an A recommendation (“No recommendation. Resume or continue 
routine sampling.' ) for samples whose current and previous ranges, and trend 
values, are normal; indeed it suggests consideration of an A recommendation for all 
samples whose current ranges are normal, regardless of the other quantities. 

Table 4. Equipment code DFKA, Atomic Emission 
Count? of records with 
non- norm aJ laboratory recommendations 



Element 


Normal 

range 


M arginal 
range 


High 

range 


Abnormal 
range | 


Fe 


1797 


22 


6 


7 


Ag 


1823 




8 


1 


A1 


1830 




2 


1 


Cr 


1830 


2 




1 


Ni 


1764 


41 


23 


4 1 


Ti 


1824 


5 


3 





To examine the records which contained non-normal recommendations, all 
records were deleted whose reason for taking the sample was T, K, AT P or X , 
as above; also deleted were those records whose laboratory recommendation code 
was A (No recommendation. Resume or continue routine sampling.). D (Unable to 
analyze sample as received. Submit resample ASAP.), G (Suspect contamination. 
Submit resample together with sample of new oil servicing this unit to the labo- 
ratory ASAP.), or U, V or W (codes used only for Navy units). The remaining 
records then presumably contain those for which the laboratory called for some- 
thing othei than continued routine sampling. The resulting counts of numbers of 
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records with readings in the various ranges axe presented in Table 4, for the atomic 
emission readings for DFKA, and in Table 5 for the atomic absorption readings for 
this same TEC (again, the same information for the other TEC s is given in the 
appendix). It is interesting to compare these counts with the earlier values given in 
Tables 2 and 3 for TEC DFKA; note that Table 2 gives a count of 65 records (out 
of the total of 126,038) in the abnormal range for Fe. Recall as well that the deci- 
sion guidance table suggests special action should be called for with any record in 
the abnormal range. Thus, one would expect to find 65 records in the non-normal 
category with abnormal Fe counts, rather than just 7 as indicated in Table 4. This 
phenomenon is quite apparent for all elements and ranges (and the other TEC s as 
well, reported in the appendix). One possible explanation (thought to be unlikely) 
is that the operator did not choose to act on such abnormal range values; the more 
likely explanation is simply that data entry and/or reporting errors are responsible 
for inflating the counts in the earlier tables. Note as well, from Tables 4 and 5, 
that the great preponderance of contaminant readings for all elements fall into the 
normal range, rather than one of the higher ranges which would flag special action. 
Granted that the spectrometric laboratory recommendation is based only on their 
oil analysis records, and the Laboratory Manual decision guidance table, it seems 
apparent that the trend calculation (not reported on the data tapes) must be the 
cause of almost all non-normal recommendations issued (for the TEC s examined). 

Table 5. Equipment code DFKA, Atomic Absorption 
Counts of records with 
non-normaJ laboratory recommendations 



Element 


Norma] 


MarginaJ 


High 


Abnormal 


range 


range 


range 


range 


Fe 


47 








Ag 


47 








A1 


43 


1 


3 




Cr 


47 








Ni 


47 








Ti 


47 









Consistency Conclusions 

From Tables 2 and 3, and those presented for the other five TEC s in the 
appendix, there appears to be wide variations in the placements of the normal, 
marginal, high and abnormal ranges across elements, for all TEC s. However, 
granted the inconsistencies found in the counts as mentioned above, it is not fea- 
sible to really make any such comparisons with the data available; any and all of 
the differences found in locations of the ranges may be totally caused by data entry 
errors, which are not possible to identify from the data provided. 
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Setting Normal, Marginal. High and Abnormal Ranges 

In spite of the inconsistencies or data-entrv errors already noted, it seems clear 
that the normal, marginal, high and abnormal ranges employed (for the TEC s 
examined) are extremely conservative; that is, the great preponderance of counts 
observed fall into the normal range. This could be caused by an excessively large 
normal range being listed in the Laboratory Manual. In any system which employs 
analytic data for diagnostic purposes, there axe two types of errors which could 
occur: 

i. Requesting special action when it is not in fact needed. 

n. Not requesting special action when in fact it may be necessary (and could lead 

to loss of life and equipment). 

As the “normal” range is lowered, the probability of occurrence of this first 
type of error necessarily increases while the probability of occurrence of the second 
type of error necessarily decreases. The actual values for these probabilities of error 
are not known, but this general behavior must occur. Thus, an excessively large 
normal range will help to avoid calling for special action when it is not needed, but 
runs the risk of allowing the second type of error to occur. Great care is needed in 
setting the normal range to properly balance these quantities. 

Returning to Tables 2 and 3 (which admittedly appear to be affected by data 
entry /recording errors) there is a large disparity in the proportions of non-normal 
records from one element to another. If this phenomenon is real (and not just caused 
by data errors), it does not seem desirable; that is. granted one had perfectly clean 
data, and a very large sample of records, it would seem ideal that the proportions of 
non-normal records should be at least roughly the same across elements (whether 
its value may be .001 or .0001 or whatever). Variation in this proportion across 
elements would seem to indicate that one is willing to take bigger risks with Fe. say. 
than with Ag. which may not be reasonable. 

If it is desired to continue employing the current type of system, that is one in 
which tables of normal, marginal, high and abnormal limits are published for TECs 
to apply for all such ESN s, it is recommended that the limits employed be reviewed, 
and possibly revised, yearly. When a new 7 TEC enters the inventory the initial limits 
could be determined by those employed for the “most similar" currently employed 
TEC. As actual oil analysis records are accumulated for the new TEC, say once a 
total of 10,000 analyses have been recorded (ideally without error), one could then 
construct relative frequency histograms of the type discussed in this report for each 
element of interest and review 7 the performance of the ranges employed. The most 
logical variables to examine in such a review 7 are the proportions of records which 
fall into the four ranges (if four are U9ed) for each of the elements monitored; as 
discussed above, it would seem on the surface desirable to have these proportions at 
least roughly equal for all elements; the actual magnitudes of the proportions should 
also be reviewed, since they have a bearing on the probabilities of committing the 
two types of error discussed above. Proportions of .999. .0003. .0003 and .0002 
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might serve well for the classes normal, marginal, high and abnormal; since the 
engine manager bears responsibility for his TEC the actual decision for setting 
these proportions must be his and should include serious consideration of the two 
types of error already mentioned. 

The current guidance for making laboratory recommendations, based on spec- 
trometric oil analysis records, suggests decisions should be driven only by the cur- 
rent and next-previous range values for the elements monitored, and the computed 
trend values for these elements. Decision guidance tables are provided as an aid in 
arriving at the recommendation made, based on these quantities, regardless of the 
number of hours since the oil has been changed. In spite of the inconsistencies of 
counts already pointed out, it appears that there is a definite tendency for the ppm 
counts observed to increase with the number of hours since oil change; if this phe- 
nomenon is real, the values used to define the normal, marginal, high and abnormal 
ranges should also possibly shift with the number of hours since oil change. 

Reference [2] describes a system employed with the Air Force CEMS-T\ r pro- 
gram which has distinct advantages in monitoring oil analysis records, granted mod- 
ern computing power is available. First, since it is computer-based, it is capable of 
doing much more sophisticated computations than one could expect from a labora- 
tory technician and can take advantage of more available information beyond just 
the current and next-previous readings for a given ESN. Second, it makes use of the 
number of hours since the oil was changed, for the sample submitted; the recom- 
mendation produced can shift with this variable if that seems appropriate (and will 
not shift if not appropriate). Third, its recommendation is based on the behavior 
of the particular ESN from which the sample was drawn; it does not depend simply 
on static tables which are the same for all ESA's with the same TEC. This behav- 
ior seems quite consistent with the On Condition Maintenance philosophy which 
is currently popular. It is recommended that the type of procedure described in 
this reference be seriously considered for implementation at any laboratory with the 
requisite computing equipment. 
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Appendix 



This appendix presents the supporting tables and graphs for the o other TEC s 
discussed in the attached report; TEC EPJA is a turbo-fan engine (as is DFKA j. 
while TECs BSQA and BSPA are both turbo-jet engines and TECs LLDA and 
LLLA are turbo-prop engines. Four graphs and four tables are presented for each 
of these TEC s, corresponding to those presented earlier for DFKA. The graphs 
presented give proportions of readings from the tapes which contained the various 
(whole) ppm values for each of the elements monitored, overall, for both types of 
instrument; also presented are pairs of histograms illustrating the shift to higher 
counts for those engines with larger values for hours since oil change. 

The tables presented give the number of reported records to fall into the four 
ranges of normal, marginal, high and abnormal contents, for both instrument types, 
as well as the counts made from the actual non-normal records. As with TEC 
DFKA. there appears to be a major problem with data entry errors, or some other 
phenomenon, which causes inconsistencies in these types of count. The tables and 
graphs are organized into groups according to type of engine and TEC. 
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Turbo-fan engines 



Proportion of readings versus ppm content 

Based on 80,195 records 







Figure Al. Equipment code EPJA. Atomic Emission 



Proportion of readings versus ppm content 

Based on 35s records 
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Figure A2. Equipment code EPJA, Atomic Absorption 
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Turbo- fan enginls 



Proportion of readings versus ppm content 
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Figure A3. Equipment code EPJA. Atomic Emission 
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Turbo-fan engines 



Table Al. Equipment code EPJA, Atomic Emission 



Element 


Normal 

range 


Marginal 

range 


High 

range 


Abnormal 

range 


Proportion 
not normal 


Fe 


0-9 


10-13 


14-17 


18 and over 


0.0029 


Count 


80,193 


186 


25 


24 


Ag 


0-3 




4 


5 and over 


0.0020 


Count 


80,184 




129 


34 


Al 


0-3 




4 


5 and over 


0.0004 


Count 


80,394 




2 


29 


Cr 


0-3 




4 


5 and over 


0.0004 


i Count 


80.393 




22 


8 


1 Cl1 


0-10 


11-14 


15-17 


18 and over 


0.0001 


| Count 


80.410 


0 


0 


9 


Ni I 0- 3 


6-7 


8-9 


10 and over 


0.0003 


Count 


80.240 


19 


1 


5 


Ti 


0-5 


6 


7-8 


9 and over 


0.0001 


[ Count 


80.185 


3 


2 


5 



Table A3. Equipment code EPJA. Atomic Emission 
Counts of records with 
non-normal laboratory recommendations 



Element 


Normal 


Marginal 


High 


Abnormal 


range 


range 


range 


range 


Fe 


771 


72 


24 


6 


Ag 


864 




5 


4 


Al 


868 




2 


3 


Cr 


860 




12 


1 


Cu 


873 








Ni 


862 


11 


1 




Ti 


867 


3 




3 



Table A2. Equipment code EPJA. Atomic Absorption 



1 Normal 

! Element 1 

1 ranc* 


| Marginal 
range 


High 

range 


Abnormal 

range 


Proportion 1 
not normal j 


Ft ; 0-5 1 6 


7 


8 and over 


0.0000 


. Count | 358 


0 


0 


0 


I Ag 0-3 




4 


5 and over 


0.0000 


1 Count 1 358 




0 


0 


Al ; 0-3 




4 


5 and over 


0.0000 


i Count 


358 




0 


0 


j Cr 


0-3 




4 


5 and over 


0.0000 


1 Count 


358 




0 


0 


Cu 


0-4 


5-6 


7 


8 and over 


0.0000 


Count i 


354 


0 


0 


0 


Ni 


0 3 


4 


5 


6 and over 


0.0000 


Count 


358 


0 


0 


0 


Ti 


0-2 




3 


4 and over 


0.0000 


Count 


358 




0 


0 



Table A4. Equipment code EPJA. Atomic Absorption 
Counts of records with 
non-normal laboratory recommendations 



Element ! 


Normal 


1 Marginal 


High 


Abnormal 




1 range j 


range 


range 


range 


There were no non- 


normal recommendations made. 
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Turbo-jet engines 



Proportion of readings versus ppm content 

Based on 42.2*9 records 
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Figure A5. Equipment code BSQA. Atomic Emission 



Proportion of readings versus ppm content 

Based on r< < ord* 
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Figure A6. Equipment code BSQA, Atomic Absorption 



A 5 



Turbo-jet engines 



Proportion of readings versus ppm content 

u , < 210 □ Based on 17,802 records 

Hours since oil change ~ D 

> 210 ■ Based on 24,48 1 records 
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Table A5. Equipment code BSQA, Atomic Emission 



Element 


N o r m aJ 


MarginaJ 


High 


Abnormal 


Proportion 


range 


range 


range 


range 


not normal 


Fe 


0-29 


30-36 


37-44 


45 and over 


0.0009 


Count 


42,251 


17 


5 


16 


Ag 


0-3 


4 


5 


6 and over 


0.0005 


Count 


42,267 


1 


0 


21 


1 A1 


0-8 


9 


10-11 


12 and over 


0.0001 


Count 


42,285 


1 


2 


1 


Cr 


0 10 


11-12 


13-14 


15 and over 


0.0003 


Count 


42.276 


2 


1 


10 


1 Cu 


0-18 


19-22 


23-27 


28 and over 


0 . 000 * 


j Count 


42,256 


7 


0 


26 


Mg 


0 14 


15-17 


18-21 


22 and over 


0.0011 


! Count 


42.24 ! 


23 


6 


16 



Table AT. Equipment code BSQA. Atomic Emission 
Counts of records with 
non-normal laboratory recommendations 



Element 


Normal 


Marginal 


High 


Abnormal 


range 


range 


range 


range 


Fe 


308 


7 


3 


1 * 


Ag 


319 








AJ 


318 


i 




Cr 


319 




i 


Cu 


315 


1 


Mg 


319 



Table AC. Equipment code BSQA, Atomic Absorption 



Element 


Normal 

rang/ 


Marginal 

range 


High 

rangf 


Abnormal 

range 


Proportion 1 
not normal j 


Tc 1 0-14 

| 1 


15-18 


19-23 


; 24 and over 


0.0000 


Count | 5.82* 


0 


0 


0 


Ag 


0 1 




r ) 


3 and over 


0.0009 


* Count i 


5. *23 




3 


o 


A1 j 0 2 


! 


3 


4 and over 


0.0009 


■ ' 1 

Count i 5. *23 




5 


0 


Cr | 0-5 


6 


7 


8 and over 


0.0002 


Count 


5.827 


0 


0 


1 


Cu 


0-7 


8-9 


10 


1 1 and over 


0.0000 


Count 


5,828 


0 


0 


0 


Mg 


0-7 


8-9 


10 


11 and over 


0.0000 


Count 


5.82* 


0 


0 


0 



Table A8. Equipment cod< BSQA. Atomic Absorption 



Counts of records with 
non normal laboratory recomiiK ndat im ^ 


Elc rcmnt 


Normal 


Marginal ! High A! iioiiim! 


range 


■ | 

range ' rang- rang* 


Fe 


14 




Ag . J 


h 




A1 


14 




Cr ' 


14 




Cu 


14 


| 


Mg 


14 





Turbo-jet engines 



Proportion of readings versus ppm content 

Based on 26.022 records 
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Figure A9. Equipment code BSPA. Atomic Emission 



Proportion of readings versus ppm content 

Based on 1 0.396 records 
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Figure A10. Equipment code BSPA, Atomic Absorption 



Tl RBO-JLT ENG IN ES 



Proportion of readings versus ppm content 

u i v < 210 D Based on 8,731 records 
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Figure* All. Equipment code BSPA. Atomic Emission 



Proportion of readings versus ppm content 

u . < 210 D Based on 3,853 records 

Hours since oil change — _ r » . . , 

>210 ■ Based on 0.54 3 records 






Figure A12. Equipment code BSPA, Atomic Absorption 



Turbo-jet engines 



Table A9. Equipment code BSPA, Atomic Emission 



Element 


Normal 

range 


Marginal 

range 


High 

r&nge 


Abnormal 

range 


Proportion 
not normal 


Fe 


0-29 


30-36 


37—44 


45 and over 


0.0011 


Count 


25,996 


10 


7 


12 


Ag 


0-3 


4 


5 


6 and over 


0.0005 


Count 


26,011 


2 


1 


9 


A1 


0-8 


9 


10-11 


12 and over 


0.0001 


Count 


26,023 


0 


2 


0 


Cr 


0-10 


11-12 


13-14 


15 and over 


0.0002 


Count 


26.021 


1 


1 


2 


Cu 


0-18 


19-22 


23-27 


28 and over 


0.0015 


Count 


25,984 


23 


6 


10 


Me 


0-14 


15-17 


18-21 


22 and over 


0.0010 


Count 


25,996 


10 


6 


10 



Table All. Equipment code BSPA, Atomic Emission 
Counts of records with 
non-normal laboratory recommendations 



Element 


Normal 

range 


Marginal 

range 


High 

range 


Abnormal 

range 


Fe 


248 


2 






Ag 


249 




1 




A 1 


249 




1 




Cr 


250 








Cu 


244 


4 


2 




Mg 


246 


o 


o 





Table A 10. Equipment code BSPA. Atomic Absorption 



i 

| Element 


Normal 

rangf- 


Margin al 
range 


High 

range 


Abnormal 

range 


Proportion 
not normal 


Fe 


0-14 


15-18 


19-23 


24 and over 


0.0004 


Count 


10,392 


0 


0 


4 


Ag 


0-1 




2 


3 and over 


0.0003 


Count 


10.393 




0 


3 


A1 


0-2 




3 


4 and over 


0.0004 


Count 


10,392 




2 


2 


Cr 


0-5 


6 


7 


8 and over 


0.0002 


Count 


10,394 


0 


0 


2 


Cu 


0-7 


8-9 


10 


11 and over 


0.0010 


Count 


10,386 


1 


2 


7 


Mg 


0-7 


8-9 


10 


11 and over 


0.0007 


Count 


10.389 


0 


0 


7 



Table A12. Equipment code BSPA. Atomic Absorption 
Counts of records with 
non-normal laboratory recommendations 



Element 


Normal 


Marginal 


High 


Abnormal 


range 


range 


range 


range 


Fe 


46 








Ag 


46 








Al 


45 




1 




Cr 


46 








Cu 


42 


1 


2 


1 


Mg 


46 









A- 10 



Turbo-prop engines 



Proportion of readings versus ppm content 

Based on €,180 records 
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Figure A13. Equipment code LLDA, Atomic Emission 
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Figure A14. Equipment code LLDA. Atomic Absorption 
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Figure A15. Equipment code LLDA. Atomic Emission 



Proportion of readings versus ppm content 

Hours since oil change — ? Based on 2-1 record 
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Tl'KBO-PROP engines 



Table A 13. Equipment code LLDA, Atomic Emission 



Element 


Normal 


Marginal 


High 


Abnormal 


Proportion 


range 


range 


range 


range 


not normal 


Fe 


0-14 


15-17 


18-21 


22 and over 


0.0083 


Count 


6,130 


33 


9 


9 


Ag 


0-3 




4 


5 and over 


0.0031 


Count 


6,163 




0 


19 


A1 


0-10 


11-12 


13-14 


15 and over 


0.0002 


Count 


6,181 


0 


0 


1 


Cr 


0-3 




4 


5 and over 


0.0026 


Count 


6.165 




11 


5 


Cu 


0-8 


9 


10-11 


12 and over 


0.0011 


Count 


0,174 


0 


3 


4 


M C 


0-8 


9-10 


11-12 


13 and over 


0.0068 


Count 


6.138 


20 


16 


6 



Table A 15. Equipment code LLDA. Atomic Emission 
Counts of records with 
non-normal laboratory recommendations 



Element 


Normal 

range 


Marginal 

range 


High 

range 


Abnormal * 

range | 


Fe 


151 


6 


5 


I 


Ag 


162 






1 


A1 


162 






i 


Cr 


160 




2 




Cu 


160 




1 




Mg 


157 


1 


2 


2 1 



Table A 14. Equipment code LLDA, Atomic Absorption Table 



LlcnK nt 


Normal 

range 


Marginal 

rangt 


High 

range 


Abnormal 

range 


Proportion | 
not normal | 


Fe 


0-7 


8 9 


-10 


1 1 and over 


o.oosc 

I 


Count i 


800 


6 


0 


1 


Ag 


0 1 




o 


3 and over 


0.0000 


j Count 


813 




0 


0 


A1 | 0 4 


5 


6 


7 and over 


0.0000 

i 


Count | 813 


0 


0 


0 


Cr 


0 1 




2 


3 and over 


0.0271 


Count 


791 




21 


1 


Cu 


0-3 




4 


5 and over 


0.0000 


Count 


813 




0 


0 


Mg 


0-3 


4 


5 


6 and over 


0.0000 


Count 


813 


0 


0 


0 



A1C. Equipment code LLDA. Atomic Absorption 
Counts of record « with 
non normal laboratory recommendations 



Element 


Normal Marginal High Alu v-rmal 
range range range range 


Fe 


7 | 3 3 1 


Ag 


14 


A1 


14 




Cr 


14 




Cu | 14 


i 


Mg 


14 

i li 



A 13 



Turbo-prop engines 



Proportion of readings versus ppm content 

Based on 2,014 records 
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Figure A17. Equipment code LLLA. Atomic Emission 



Proportion of readings versus ppm content 

Based on 665 records 
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Figure A18. Equipment code LLLA. Atomic Absorption 



A-14 



Turbo-prop engines 



Proportion of readings versus ppm content 



Hours since oil change 



< 140 D 

> 140 ■ 



Based on 806 records 
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Figure A 19. Equipment code LLLA. Atomic Emission 



Proportion of readings versus ppm content 

Hours since oil change - 140 ° Based 0,1 317 rrcord ' 
>140 i Based on 34* records 





A 15 



Turbo-prop engines 



Table A 17. Equipment code LLLA, Atomic Emission 



Element 


Normal 

range 


Marginal 

range 


High 

range 


Abnormal 

range 


Proportion 
not normal 


Fe 


0-14 


15-17 


18-21 


22 and over 


0.0015 


Count 


2,011 


3 


0 


0 


Ag 


0-3 




4 


5 and over 


0.0010 


Count 


2,012 




0 


2 


Al 


0-10 


11-12 


13-14 


15 and over 


0.0000 


Count 


2,014 


0 


0 


0 


Cr 


0-3 




4 


5 and over 


0.0000 


Count 


2.014 




0 


0 


Cu 


0-8 


9 


10-11 


12 and over 


0.0000 


Count 


2,014 


0 


0 


0 


1 Mg 


0-8 


9-10 


11-12 


13 and over 


0.0020 


Count 


2,010 


4 


0 


0 



Table A 19. Equipment code LLLA, Atomic Emission 
Counts of records with 
non-normal laboratory recommendations 



Element 


Normal 


Marginal 


High 


Abnormal 


range 


range 


range 


range 


Fe 


28 








Ag 


28 








Al 


28 








Cr 


28 








Cu 


28 








Mg 


28 









Table A 18. Equipment code LLLA, Atomic Absorption 



Element 


Normal 

range 


Margin al 
range 


High 

range 


Abnormal 

range 


Proportion 
not normal 


Fe 


0-7 


8 


9-10 


11 and over 


0.0045 


Count 


663 


3 


0 


0 


Ag 


0-1 




2 


3 and over 


0.0000 


Count 


666 




0 


0 


Al 


0-4 


5 


6 


7 and over 


0.0000 


Count 


666 


0 


0 


0 


Cr 


0-1 




2 


3 and over 


0.0000 


Count 


666 




0 


0 


Cu 


0-3 




4 


5 and over 


0.0000 


Count 


666 




0 


0 


Mg 


0-3 


4 


5 


6 and over 


0.0165 


Count 


654 


5 


6 


0 



Table A20. Equipment code LLLA. Atomic Absorption 
Counts of records with 
non-normal laboratory recommendations 



Element 


Normal 

range 


Marginal 

range 


High 

range 


Abnormal 

range 


Fe 


6 


3 






Ag 


9 








Al 


9 






. 


Cr 


9 








Cu 


9 








Mg 


3 


4 


o 
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